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^(sing judgmental data coUecteSTfroni an Air Force operational unit, the method developed under ibis study effort 
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options by means ofjUtf^hniquc inco^poi^ting^i DODT and a modification of the method of surtmatcd ratings >Vas 
a feasible approached could provideoife methodological procedure for measuring the effects of advances in 
technology on human resources. 




\ 



er|c 



Uni61a;$sified 



SEC^ITY Cji ASSt/TI^ATION OF THl^ P AG^(Wh*n Dmtm Entmrtid) 



■ I 
J- 



SUMMARY 



PROBLEM 

. ■ ■ ? . 

The purpose of this study was to develop , apply, and evaluate the 
feasibility of a procedure for measuring the effects of technology on 
human resources. Interest was centered on development of a tool For use 
by system designers and manpower planners whi!ch would permit the specif 1- 
catlon> In advance of syst^ development, o^- the effects of a technologl- / 
cal Innovation on' the human resources required toJnteract In the opera- 
^tlon and maintenance of the system. 

APPROACH 

; A tiotm^fclve forecasting procedure Igaowh as a Design Option Decision 
Tree (DODT) was employed to graphl<ially dep±c^ the sequence of engineering 
decisions In complex weapon systemsA The technological design options 
;dvallal>le at each of the decision points wer* established for two Air Force 
systems, Renjotely Piloted Vehicle and Dlgital\ Avionics Informatlpn Systems. 
With the DODI It was possible tojuUd^lfy the level of technology represented 
among the optlond/lnto examplW^of pta^e-of-the-art. Incoming o^ advanced 
technology. 



Emphasis of this research effort ha^ been directed toward a concentra- 
tion oV analysis of the Digital Avionics Information System (DAIS). This 
emphasJrS served to dictate to d large degree the data sources available for 
analysis. a DAIS configured weapon systems does not presently exist In 
the Air Porfce Inventory, maintenance personnel on the A-7 weapon system, 
which qoes Include some dlglta^, .avionics, were selected as judgmental ^ex- 
perts for the data source In tliis study. Judgmental data were collected 
from the maintenance personnel on a series of selected human resource para^ 
meters. Judgmental data were collected as the analysis base for this effort. 

(I 

Three classes of data were Included In the analysis: first, humfi^n re- 
source components; second, the hardware decision options; and third, selected 
background and experience information on the technicians who served as the 
source of the data. 

The human resource components Included in this study were: 

Worker Preference 

Desirability of Written Procedural Manuals 
Level of Skill Requlre4 
Difficulty Level of Task 
Extent of Training Required 
Environmental Effects on Maintenance • 
Amount of Time Required for Maintenance 

The data collected were statistically 'analyzed with t-tests, analysis ^ 
of variance, multiple range test and correlation matrixes. 



RESULTS AND CONCLUSIONS 




Poi^'the seven resource componept^ selecfced fait feaslb±litf4tudy, th'e^ 
survey i^esults indicate that four oif the coiiionents , i*e», wtfi*er prefereacd, 
akiU level required/diff iculty level of tafik, andf tliae required t> nwdthtain 
or trpubleshoot Impacted significantly lr{ half ^more of the declsl«i;i folnt/ 
option alternatives 8aii?)led. Further, the options avill^bie kt three of thi 
dedLslon points! studies appeiredl to haW.the heaviest Inpajct brt,^thp huajm 
resource components under lAveftlgatjton. These decision pblnfcs Impact liig on 
four or more of the human rfe86t|ceMomponents were: the <^>of£e^of ^single ory' 
nultlple miatlplex data buBjes/lfer tlje system; the comnonamti^'of LRU^ptoces- 
sots; and the^tyi)e/of softwye|struc^*..=......,_^_^^ ,^=.--2-— — 

, The data served to sup/poifft the contei^tlon that "tecfiiKk«gjial chtflcqs * 
tfde durlTig the design protesji will havtK'arylng de^eeB of lmpapiI^m4itinMm ' 
E^Bource parametets. In iddltlop those technological choices ^wWLdi ajmedr 
have a Btrpng liiq;>sict dn hinun resource jparaUeters may liig>lict onl^^rSn cer- 
In p^TfuiietetB and not/on all parameters . The degree of techno ipN^ Imr^ 

dejyendent upon /the human resource parameter or 4et of njt^^^ers of 
I'eMity The methodology 'developed in thla study wa& ge6er#l1y ^^ep'table 
to thre JfespondentB. Jt plroVld^d an Initial step iif atjtenqJtlng t0 predict 
, yiJitact of new tc?!hnolpgy yt^on humnn reBource iparaalcterB by reduclngVthe 
lesign process to a nezlef oi decisioii points which could be judged by fiteld 
/exiterlended technician* ^n ^erms of the human resource parameters selected. 
/ \ / I ■ - ^ ^ 

/ . 
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j V ■ I * -iifeiMpwiCTioN AND aAdtCRouiin y * \ 

Historically aan's' pro|>enslty Co predict Che future can be docuaented 

frop the ptohetlc, Ori|clel3f Delphi through the fiction^ of Jules Verne, into 

• •» «^ ' * 

the scientific reals of concern after the setdnd world var. the eaphasis 
on establishing' future plans, both govenmental and industrial, caused 
an upsurge of interest in forecasting change. (Clarkel 1969). The initial 
technique of , forecasting consisted in thfe projections made by experts in a 
^iVen f iel4* This t^echnlque has giv^n way to the develdpnent of aore pre- 
else Methods^ less dependent vpon individuaJL genius and sore dependent upon« 
scientific precepts. 



'The emergence o^f the' discipline of technological foriecastlng in the 
past decade Is an JLndlcatlon of the requirement tb be able to estlsatA 
future situationfe in order to plan appropriately. Vhile technologica]^ fore^ 
casting has usually addres*^^ the^ lapact;^ of new technological concepts on 
flat dwar e' ephfigurat ions ^ and utilization, it could also be used tb^^^roject 
hilBian resource ^qul^wsiht s In* the Arae^ Services and especially the Air 
Force, an.; Interest in ^nkiptt '^technological advancements and manpower 

' ' requirements can be found in the process of building new weapon systems. 

. ' ■ --^ \ • 

Through (he Air Po^e System Program Offices (SPO's), thi manageMnt of 

f \ ' . ^ 

the development w'iDf a nfw weapon system is maitftalned* Wit^iln this manage- 

ment system a |orm|Mr 'projection is made in terms of the personnel and training 

required to operate and maintain the. system. 

i> ■ ' ■ . . 'v ' . i ^ • 

A capablMty to relate the. discipline of technological forecasting to 



the more narrow concern of humad resource requirements for a weapon system 

ERJC ■ I ■ ■ j, , , tz 





appears to be fea^ble it this tltte. By developing an amalgm of the two » 

a iiethodology coul<^ be. 'developed t'o predict the impact of Ixinov^tlons In 

' ' ■ ' " "^n ■ *•* • ■ ■ . • - ^ 

technology on the hunin' resource requirements for a given system. This 

methMOlogy v^uld bk of value to the armed forces but would also be useful 

for anyone Interested In determining the Impact uppn humaif resources of a 

new^echnology. / ^ ,^4. . 



iL''^ '--^'i ■ ' From the f ecent-psist one of tjxe major prpblons along . these lines has 
b^en the cc^cem with the effect of automat^fittf^cA human resources. 

-. -t ■ ■ ■ ' . :■ ■ ■ • ■ ^ ^ ■ ■ 

' . The iK>tft severe problem was encountered In the area of determining 

■ -\ ■ . ■ . ' ■ . , - 

the effects of increasing automation on human resource parameters. In con- 
sort vlth all hm&an resource compohents reviewed » xio workable method of 

qualification was fbuxid. Additionally , as strongly asserted by an authority ^ 

• ' • , '■ ■ *' 

In the fleldy In spite of 20 years study of the problem » a categorical state- 

• ' ■» , ' 

ment concerning the effect of automation on skill requirements cannot be 
made (deGreene^ .1974) . This same author concluded that» "... It will 
probably be years before a predictive » or even an explanatory » theoty of 
technicar change ^Is developed.** The shortcomings of the present capability 
in th§ area of quantification of technology Impact on human resource components 
has been reported (i^otter and Pleterly» 1974) . 

In the search for a means of forecasting and assessing technology the 
result was more positive. The recent literature supported the use of a norma- 
tlve approach to forecasting. Of the available i^rmatlve techniques to fore- 
castings the conclusion was reached that a modification of the relevance tree 
approach (Cetron» 1969) » known as a Design Option Decision Tree (DODT), (Askren 



and Kbrkan/ 1971) vould provide a means of graphically depicting the sequence 
of engineering decision^ required and the dedlga optional available at each of 
the decisions points In a system design process. The DdM Is a method for 
locating all decision points within a system. Thus, those decision points vlth- 
In a system which represent new technologies can be Id^tifled on the basis of 
expert judgment and assigned a position \d.thln thej^ree, as well as graplilc 
reflection of those decision points whlc^ d^lc^proven hardware technology 

options. ^ 

. ' ' • .■ 

The goal of this research effort was the establishment of methods or 
techniques for determining iand defining. In advance of system application, the 
components of an Incoming technology and meyisuring the. effects of that tech- 
nology on human resource parameters. The impact and change on the operant Ion 
and malntenimce of a system which Incorporates such a technology was the 
major consideration. 

One of the most striking characteristics of technological forecasting Is 
that there Is no standard method for determining what constitutes a "neiT tech- 
nology." In the literature a "new technology" may range f rom a p^cess for 
produc ting some component to the use of a new component. In this research 
effort, this problem .was recognized but not solved. The new technology In this 
effort was reduced to types of options made at design decision points. Some of 
the options were not as Innovative as others, therefore the new technology 
Introduced at the decision point varies considerable. 

■•• ■ •■• ^- . ■ .■ - • • . ■ " I 

Pbints of a selected DesAgn Option Decision Tree (fiODT) were chosen to 

reptesent the variance of the technology concerned. t%fe use of the DOOT to 
Identify a set of decision points appeared to bie a reasonable approach to con- 
trolling the sl^e of the new technology. At each decision point options are 
available which range from previously used options to new options which Intro- 
duce the use of a new technology. The unit of new technology yatles across the 
set of decision points selected W each declslonj>olnt has approximately equal 
weight m the design process. 



INTRODUCTION TO HUMAN RESOURCE COMPONENT QUAliTIFICATION EFFORTS 
■ , ' ' Si " ■ ' / ^'l'-' * 

•. • ' . . ' ■ " ' ' . 

tU dearth of established techniques for acceptable quantification of 
human, resource parameters in man/machine systems became apparent in the 
. P6tter and Dleterly (1974) review of rebent literature. There is no method 

tiiat^has been shown acceptable for the detailed prediction of the effects of ^ 
-^an Incondng technology on the human resources required to interact with that £ 
technology. ' ' \ 

The goal underlying this human resource component quantification effoirt ^ 

was to develop unique scalar methods for measuring the effects of a sjiecific 

... ' ■ ^ ,i ' . 

forecasted technology on Air Fors^e human resources ? In this study, as an interim 
step toward achievement of \ quantification of the effects of technology, judg- 
mental data was collected to* serve as an analysis base. This data base was 
used to seek inpights for future directions to be followed in joining ob- 
jective quantification procedures with the Design Option-Upcislon Tree 
technique. . ^ r 

Ttf^ selection of the specific human resource components for study was 
gui4ed by^wo primary concerns., First, an assessment of the ability to obtain 
judgmental data from field personnel in operational units. With this selection 
criterion, seven human resource components were chosen for use in a feasibility 
demonstration of the quantification procedure proposed. 




The human resource components viewed as amenable to data collection were: 
Worker preference 

Desirability of written procedural manuals 

Level of skill required 

Difficulty level of task 
Extent of training required 

Environmental effects on maintenance 

Amount of time required for maintenance \ 

The second area of 'concern was that the human resource components chosen 
for study would allow mteaningftil questions to be asked at each decision point 
in the DODT to which they were applied. 

4 
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^^'^^ODS of quantification' . 

. The term "quantification" can be regarded as being synonymous with 
measuirement, the act of p^^iring of * the members ^6f two sets. This process 
o of matching an event to sjbme scalar value implicitly 'depends on knowledge 
of the appropriate underlA^ljng relationship between the component and the 
Quantizing scheme/ 

• I 

The techniques for arriving at a definition of this relationship have 

■ . ! > • 

remained undefined fbr all excfept the most gross sjtatements of association. 
Thelse gross association predictions are more of zh^ type referred to by 
Stevens (195>) as metathetiq. In\essence, they d^al only with nominal quan- 
tification (qualification), not with scalar expression < 



With quantification defined as a proceeds of matching the elements of 
sets, a number of procedures for accomplisl^ing this matching task are posd^ble* 
In this section, "consideration will be giyen to the generic methods avaiiiable 
and the possibility^of^ application of each to the present task will be 
discussed. 

For practical utility in objective' impact decisions on advanced systems, 
the decision makers must have access to at least an oi^dinal scale. The attri- 
butes of such ^a scale represent the minimum requirement for defining In advance 
a "best design option." As Indicated earlier in this paper, those methods of 
quantification found in the current literature are of little applicability 4s 
they are, for the most patt, ireptesentative" of nominal quantification. 

Ideally, to ,function in: the area trade-off analysis, the design 
engineer requires aceess to a Wtio sc^le* While this is possible for certain 
considerations — A lilng surface with ^ro* lif t is conceivable — in the area of 
human resources, few comporients are /capable of ratio scaling. Illustration 
of this fact can be quickly provid/d by attempting to conceive the state 
represented by zero intellectual /apability, or, more practically for this 
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paper, hf zevq mechanical aptitude. XJiough the Ideal of ratio scaling Is 
Infrequently Satisfied, trade-off studies are still petformed. In si^ch an 
Instance, the components of variable? evalliated are not quantified dn com- 

" par^fele Units, but ; the individual conducting ^:he ttade-off fitt^dy must take 

; action as if they wfere. 



\ In an attempt to comp^nsa^e fjir this , lack of comparability across 

•. variables being treated, an attempt ha^ been made to develop a standardized 
quantification scheme for .the seV^n huma^ Resource components Included in 
the set upon which judgmental ii]iformatiotti was collected to serve^ as the data 
"b^se for analysis. Details of this atteiypt will be presented in the next 
section of this paper. ./ , 

Of ttie methods of quantification available to the researcher, certain of 
the more fundamental ones can be rejepted for ithe purposes of this study. The 
'method of average error, the method of JLjmits, and the method of frequencies, 
all fundamental psychophysical methods, are concerned with measuring or 
evaluating one stimulus. , While they can be used in scaling, there is consider- 
able inefficiency introduced ii} the number of observations required. These 



methods were therefore rejected for application. . 



1 



The quantification methods discussed below are generally regarded as 

being better suited to scalar applications than are the more fundamental 

psychophysical procedures. For each method, selected/ advantages and reasons 

% . / 

for consideration or rejection are given. ^ 

First, th^;. method of pairedj comparisons is perhaps the most popular of 
the technique^' of psychological 'scaling. A reason for its popularity may well 
lie in the fapt that this procecjure does not force transitivity on the data 
(Torgerson, i958^ . However, the natute of the judgmental task in the present 
effort was not amenable to the u&e of a decision j^rocedure about a pair of 
stimuli presented for comparison.^ For^ this reason, the method of paired 
comparisons was eliminated from further consideration. 

. /, 

./ 

The method of rank order holds ftertain attractions over the method of 
; paired comparisons. It reduces subject time yet is equivalent to the method 
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of paired compar is on6 (Thurstone, 1931).. However, like the method of paired 
comparisons, this procedure also involves the judging of a number of stimuli 
with reference to one another. Thus , this method was not considered appro- 
priate to the judgmental task in this study, ' 



The methods of interval and ratio judgments require more rigic^ assump- 
tions than do the other psychological scaling techniques. The task asked of 
the observer in this instance is to compare the size of the intervals between 

stimuli rather than to make direct judgments about the stimuli, themselves. 
Subsummed under this type of scaling is the method of equal-appearing 

intervals of Thurstone and Chave. Under this method it is possible to 

directly apply an interval scale to the set of stimuli being evaluated. As 

th,e nature of the present measurement task is not to separate n number of 

stimuli into a fixed njUmber of location^ separated by equal sense distances, 

this method of scaling Is also found to be inappropriate to the task. 



Within the methods of Interval and ratio judgment Is Included the, method 
of constant sums. Under this scaling procedure, the respondent Is required 
to assign numbers directly to the stimuli presented to him.' Here the re- 
spondent Is Instructed to distribute among the stimuli presented to him a 
total number of points, usually 100, so that the strength of sensation of each 
of the stimuli can be equated to |he number of points assigned to -It. In 
this way the ir,elatlonshlps between the stimuli can be evaluated. With this 
procedtK^' the resulting judgments can be converted Into a ratlo-^cale. This 
method could have been used with the judgmental task In the present study, 
however other considerations caused It to be rejected. A strong reason lead- 
ing to rejection was the length of time which would have been required for 
each respondent. The time availability of personnel of the 354th Avionics 
Squadron (TAG), Myrtle Beach AFB, S.C., dictated the selection of a procedure 
which would be the most productive In a minimal t'lme. This method then was 
also rejected as a vehicle for data collection In this study, prlmarll«f on 
the basis of the time constraints. 

The method of successive categories is**a procedure of scaling which has 
found popularity and broad general usefulness in scaling problems as it 



does not require that the respondent be able to classify Into an interval 

scale. It is particularly useful where; dif jElculty is expected in obtainp.ng 

stable judgments with other metpods. A procedure subsumned under this 
classification Is the Likert t/chnique frequently referred to as the metl^od 

of sunmkted ratings ,(Murphy ai/d Likert, 1937; Edwards, 1957). Concern of 

this n^thod is with the systXatic varJ.atfion of respondents tojthe stimul| 

preset^ted. This variatioti 1^ attributjed to differences in th4 subjects. 

The Libert method of summated ratings was the procedure sei^cted for 
use as a d^ta collection vehicle. The Reasons for this particular choice w^re 
many. Foi^emost among them was the rela^tive speed of administration of such 
a" scaling procedure. Secondly, the sii^plicity of the itistrument itself per-^ 
mitted standardization across the humaii resource components selected for col-\ 
lection of dat%< Thirdly, the Likert |:echnique typically shows bigger 
reliability than db other methods of scaling (Edwards , 1957) . 

On the negative side, Torgerson (1958) maintained that the use of' a 
"subject-cent6red approach has not yet led, to any great extent, to the 
development of scaling models." This comment is appreciated by the present 
authors; however, it is believed that the method of summated ratings, 
coupled with the use of the Design Option Decision Tree, will permit ^ 
collection of baseline data leading to tUe development of predictive 
equations which can make possible the specification of the effects of a 
technological advance on the personnel required to operate and maintain a 
weapon system employing that technology.* 
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PROCEDURE 



The use of the DODT coupled with a modification of the methoji of 
summated ratings appears to be an appropriate combination that would lead to 
slgnlflcaijt baseline data. Each decision point In a DODT reflects present 
state-of-the-art alternatives as well as Incoming technological advances and 
predictable future technology. As an example, the choices concerning the 
memory In the Digital Avionics Information System (DAIS) DODT to b§ discussed 
In a later section of this report contain well known options such as core, 
disc, and tape. However, In addition to these choices there Is also the 
semiconductor and bubble which are considered at the present time to be In 
the research and development stage. This type of technological spread among 
the options is present to some^ extent at each decision point in the DODT and 
is therefore^ Inherent in the wvtlre^ DODT. The respondent is able to evaluate 
these choices with respect to the questions asked based not only upon actual 
experience, but upon education and the Inherent common Interest of individuals 
involved in the field of digital avionics. Therefore, this procedure should 
elicit numerous resource component data of valxie as Inputs to engineering 
design decisions for the System. 

Rather than attempt to quantize the entire DAIS DODT, it was decided to 
utilize only selected design option decision points.. This decision was 
dictated by the time constraints on the study, in addition to the exploratory 
nature of the task, i.e., the establishment and demonstration of the 
feasibility of a method that would yield useful numerical values. 

. ) 

Therefore, only eight decision points were selected for this study. 
The rationale used in the selection process was to choose those decision 
points in the system which portrayed a technical area with which the subjects 
would be familiar by virtue of experience or training. Decision points were 
selected ,to reflect varying states of technology. For certain decision 
points, well established technology was reflected by most of the available 
options. For other points, the options heavily expressed either Incomln'fe^ 

J, 

advances in technology or predicted future techriblogical innovations but 
included established technolagy. 
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A fui:4;^^t r€^trictlQi^i%08ed In selecting the dejcdsion points 
the design options at the points selected must lend tfhemselves to human factor 

J - < . y 

type question^ dealing with maintenance and troid^cTshootlng concepts. 

The D4uS has been described by cl^slfylng the system Into four J^unctlonal 
^jbeaa referred to ad core elements. These core element^ are:/ proce3sor9|t 
system programming, memory, and remQte terminal units. In selectliik Bie / 
decision points and options for ^tudy, at .least one: decision point was sele^cted 
in each core element of DAIS. 



The DODT's portraylngSfhe DAIS consisted of a series of five pheets of 
decision options. (See Appendix ^ t6x an .encamp le) . Ftom these trees a sub-set 
of decision points were selected/ The decision pointy selected were taken 
throughout- the total set of tr^es to provide a representative sample of 
decision options. f . . / 



/ 

Selecting at least one 'decision point in each core element permits a 
preliminary demonstration of the effj^cts on one or more human resource 
parameters of the selection of various alternatives as one processes 
along a design path (see Figure 12) . „ 
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I A fitrther restriction imposed^n selecting the dedl^ion points, was that ' 
felie design options sjt the points selected must lend themselves to human factor 
"^•tyi>e questions dealing with maintenance arid troubleshooting concept?. , 

Thd DAIS l4s tJeen descritjed by classifying the system into four functional 

areas referred to as core el^ements. These core elements are: processors, 

system programming^ memory, /^nd retaote terminal units. In selecting the 

• ' f ■ , ^ 

decision, points and options f6r study, at least one decision point was selected 

each ccire element of DAIS. - ' / 

The DODT's protraying the DAIS design are shown in Appendix A (SRL 
Drawing Number 6810-02-2499, sheets 1 through 5). From these trees, the 
decision points identified below; by means of drawing number, sheet, and sheet 
location,, were selectedNyf or ^Lp^li^ation of the quantising scheme: 

SRt Dwg» No. 6810-02-2499 (Sheet 1 - D/7) "Information Processing 

\ ^ (Overa]\l System)" 

SRL^Dwg. No. 6810-02-2499 (Shdet 1 - F/4) "Information Processing 

' \ (Overall System)" 

SRL Dwg. No. 6810-02-2499 (She^t 2 - E/9) "Information Processing ' 

^ \ ' (Processlprs)" 

KL Dwg. No. 6810-02-2499 (Sheet 2 - B/6) "Inf ormatfton ^Processing 

• (ProcessjDrs)" ys 

SRL Dwg. No. 6810-02-2499 (StteSTV 3 " J^/12) "Inf oiiTnajiion Ptocessing 
• ' . ; , (System 1 Programming)" 

SRL Dwg. No. 6810-02-2499 (Sheetl- 4 - F/13) "tnformation Pri-ocessing 

^ (Memory)" 



SRL Dwg. No. 6810-02-2499 (Sheet{ 5 - D/17) Information Processing 

i (Remote I Terminal Unit)" 

SRL Dwg. No. 6810-02-2499 (Sheet 5 - D/10) "Inf ormatf ion Processing 

(Remote Terminal Unit)" 



Selecting at least one decision, point in each cdre ^lement permits a 
preliminary demonsti:ation of the effects on one or more human resource 
parameters of the selection of various alternatives as o|:ie processea along 
a design path (see Figure 2, page 34). | 



■ / 
/ 



A set of seven questions was developed which could be posed of all 
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decision points identified for data collection. Use of t1ie same set 
Questions ^ for each of the decision points, wa^ intended to create a ^standardized 
set in the technician for responses at each decision point. The decision 
points and their related design options were Assembled in a booklet included 
as Appendix B. The format ot t;hg booklet 'was designed so that title technician / , 
being interviewed was ab^Le tb observe the available design options while • ' 
answering the questioi^s. AnJ^ikert-type scale wa& associated with each question 
aiid the technician 'was asked to position his response in the form of a letter, 
i.e.,. A, B, etc., Corresponding to the specific design option^ along a con- 
tinuum, essentially following the method of summated ratings. The results 
later were quantized by translation into interval scale points. 



\ In addition to the questions involving maintenance/troubleshooting at 
the decision points, an information questionnaire also included in the 
booklet. This was done to allow weighting factors to be applied to the 
collected data if necessary, taking into account such items as background, 
training,, and experience of the technicians. ^ 

I, 

Since the present study involves digital avionics, it was decided to / 
select an operational squadron in USAF Tactical Air Command (TAG) that 
utilized the A- 7D aircraft for interview to obtain t^igj^ata required^ The 
choice of aircraft was consistent with' the present DAIS activity at the Air 
Force Avionics Laboratory which involves components of tile A-7 aircraft. 
After 'a survey of TAC squadrons that use the A-7 airctaft, the 354th Avionics 
Maintenance Squadron stationed at Myrtle Beach Air Force Base in South 
Carolina was chosen, with the ^concurrence of the Mr Force. The interview 
eflo^t was conducted from 5 through 9 August 1974. 



The data that have been collected and quantized by the scheme mentioned 
earlier have been compiled into a special form, an illustration of which ap- 
pears in Appendix C, A total of 32 subjects were interviewed thereby - 
avoiding the u«e of small sample statistics during the analysis segment of 
this study. ' • • ? 
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In an attempt to standardizja/ithe data collection process » a written set 
of points to be covered was supp^lijed to the Interviewers. These points were 
verbalized to^ each respondent?, or group of respondents, on those times when 
It was possibly to survey potfe than one technician at once. . Simplified 
escamples of the procedure were discussed to provide a more complete under- 
Standing, Of the nfitute of the task^the respondents were being asked to 
accomplish* A copy of the Instructions to Intervlewer^-is Included as 
Appendix D. 




7. 
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RESULTS 



The subject© interviewed in tjiis 9tudy,'32 in n'uinber, varied considerably 
with respect to age, background, and experience'. However, as shown in f 
Tables 1 and 2, the majority of- the subjects were enllst^ed men whose age 
was 25 or below and whose grade was E3 oy E4. The distribution j^f" ifesppndents 
has a significant effect dtt segments of the arialyses that a% descflbed . * 
later. As would be expected, this. skewed distribution is also observed 
In investigating areas such ^s total number of years iu tnilltary/civilian 
service, totil years of dyty related experience,, jand' the segment of the 
past five years applicable t^o the present duty assignment as sliowtj in * 
Ta^le 3. However, i^t may also be noted that in addition to^^enlisted men, 
both officer aijd civil jser^lce personnel w^te also represented , in the total 
sample thejreby providing some stibjecte in the sample having a greater amount 
5 of experience both in background and age. 

Subjects resploitses wereAsolicited on 168 decision optlon/humajj resoufce 

comjionent combinations. The number oi responses obtained for each option 

• * 

ranged from 32 to 16, with the median number of responses at ,31* * 
The standardized set of questions was posed for each of the eight separate 
decision points in the survey.. -The co)ie identification of each design option 
is^listed in Table 4. These sqme cpdes. are used to identify the decision 
options throughout the report. 

For purposes .of analysis, each respprfse was assigned a numeifical value 
along an eleven-point interval scale. Thus an integer value ranging from . < 
P through 10 was possible. Descriptive statistics (number responding^ mean 
-^response value, standard deviation, and range) are given in Tables 5 through 
11 for each of the design options and for each human resource component sample<j. 

In interpreting Tables 5 through 11, the reader should 'keep in mind that 
responses v^re mad e^ as a result of comparing the options located at a single 
decision point. Thus, for HRC 1 (Worker Preference) in Table 5. the' ' 
statistics for decision point lA should be compared with decision point IB. 
The comparison being made here is the worker preference for troubleshooting 
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or |naln.t£^tllng a 3ysteni e^^lo;^lng a singl^multlplex data bus design as 
opposed' toTa njttitipte rauJtiplex data tus jffonf Iguratlc^^ In this isxample,,i, 
a -higher mean response favoring , the singfe multiplex data bus conf iguratibn 
ban be' .pbserVed • 
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TABLE 1. MILITARY OR CIVIiJlAN RANK OF SUBJECTS IN MYRTLE BEACH AIR FORCE 
4^ BASE SURVEY SAMPLES 



Category 



E3 



E4. 



E6t 



E7 



2nd 

Lt- 



GSll 



USAF (Enlisted Men-) 10 



13* 



tISAF (Officers) 



Civil Service 



TABLE 2. - AGE OF SUBJECTS *IN,MYRTLp BEACH AIR FORCE BASE SUBWEY SAMPLE 



. . Age 

■ 20 and Above 
Category Below 21^25 26-30 31^35 36-40 40 Tota! 



USAF (Enlisted Men) 



16 




USAF (Officers) 



Civil Service 



Total 6 16 3 
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TABLE 4. LISTING OF DESIGN OPTIONS AND ASSOCIATED CODE DESIGNATORS-USED IN -1 
MAINTENANCE SURVEY CONDUCTED AT MYRTLE BEACH AFB, S.C., AUGUST 1974. 



CODE DESIGNATION 


IDENTIFICATION 


lA 


Single Multiplex Data Bus System 


IB 


Multiple Multiplex Data Bus System 


2A 


Shielded-Twisted Line Pair Bus 


2B 


Coax Bus 


2C 


Electro-optical Bus 


2D 


Other types of Bus 


3A 


Single Data Processor 


3B 


Multiple Data Processor 


4A 


No common processors at LRU level 


4B 


Some common processors at LRU level i 


4C 


All common processors at LRU level 


5A 


■ • • 

Modular Structure Software 


5B s . 


Mixed Structure Software 


5C 


Tightly Packed Structure Software 


6A • 


Core Memory 


68'=°'. 


Semiconductor Memory 


6C 


Disc Memory >. 


6D - 


Tape Memory 


6E 


Bubble Memory 


6F / 


Other -types of Memory 


7A 


Remote Terminal Unit Serving One System 


78 


Remote Terminal Unit Serving Several Systems 


8A 


Custom Designed Signal Modification Hardware 


'88 


Modular Design Signal Modification Hardware 
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TABLE 5. WORKER PREFERENCE (HRC^l) FOR DESIGN OPTIONS WITHIN-EACH DECISION 
POINT SURVEYED, SAMPLE OF 32 TECHfllCIANS, MYRTLE BEACH AFE, S . C . 
AUGUST 1974 • 



y 



Decision iNjint 


Number 


Mean 


Standard 










T)pvi A t* i niii 


Rnnge 


lA 


31 


6.387 


2.611 


10 


IB ■ 

S 


32 , 


4.781 


2.758 


10 


2A 


30 


4.767 


2.872 


10 


2B 


30 


2.067 


2.235 


8 






6 WMx 


2 356 


9 


2d 


20 


6 1 on 


<' 1 895 


6 


s 

3A 


32 


6.125 


.2.724 


io 




32 


S 1 S6 


2.659 


10 


4A 


30 


3.233 


3.127 

> 


10 


4B 


32 


4.750 


1..541 


6 


AT 

J 


32 

• 


7 531 


2.250 


8 








2 97^9 


ID 








1 900 


9 


5C 


32 


4.125 T. 


2.678 


"TTo 


6A 


29 


6.690 


2.A37 


10 


6B 




5 LC\L 


2 2ns 


9 


^ 6C 


29 


4.759 


3.297 


10 


6D 


28 


4.750 


2.836 


y 10 




27 




2 70^ 


to 


6F 


19 


5.368 


1.952 


— 8 


7A 


32 


^ 6.500 


. 2.750 


10 


7B 


32 


4.750 


2.449 


o 10 


8A 


31 


5.419 


"2.044 


10 


8B 


31 


6.804 


1.856 


6 
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TABLE 6, DESIRABILITY dFWllTTEN PROCEDURAL MANUALS (HRC-2) FOR DESIGN OPTIONS 
: 'WITHIN EACH DECISION POINT SURVEYED, SAMPLE OF 32 TECHNICIANS ^ ilYRTLE 

7" BEACH AFB, S.e., AUGUST 1974 / 



Decision Point 
and Option 



Number 
Responding 



Respbnse 



Standard 
Deviation 



Range 



lA 
IB 

2A 
2B 
2C 

2D ' 

3A 
3B 

4A 
4B 
4C 

5A 
5B 
5C 

6k 
6B 

6CV 
6D 
6E 
6F 

7A 
7B 

8A 
8B 



31 


8i 161 


1.667 { ' 


5 


32 


9.000 


1.118 


5 




Ji 600 


2.154 


6 


30 


/ 7.867 


1.746 , « 


6 


29 


'/ . 8.517 


1.632 ■', 


6 


22 ■ / 


8.182 


2.103 


7 


32 / 


8.281 


1.625 


5 




8.^37 


1.273 


5 


31 


8.065 


l.,740 


* 

5 


32 


8^094 


1:444 


5 


31 


8.161 


1.588' 


5 


31 


8.258 


1.502 


5 


31 . 


8.452 


1.562 


5^ 


31 


8.484 


1.644 


5 


■29 ^ 


8.414 


1.498 


5 


29 


8.345 


1.625 


5 


29 . - 


8.276 


1.436 


5 


28 


8.179 


i:649" 


5 


26 


8.577 


1.472 


5 


20 ^ 


8.250 


1.813 


5 


32 


8.000 • 


1.750 


8 


32 


8.469 


1.677 


8 


31 


8.677 


1.228 \ 


5 


31 


8.097 


1»552 


5 
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TABLE 7. LEVEL OF SKILL REQUIRED ^HRC-3)-%DR DESIGN OPTIONS WITHIN EACH. 

DECISION POINT SURVEYED, SAMPLE OF 32 TECHNICIANS, MYRTLE BEACH 
AFB, S.C., AUGUST 1974 



Decision Point 
and Option 



Number 
Responding 



Mean 
Response 



Standard 
Deviation 



Range 



lA 
IB 

2A 
2B 
20 
2D 

3A 
3B 

4A 
4B 
4C 

5A 
5B 
5C 

6A 
6B 
6C 
6D 

"SE 
6F 

7A 
7B 

8A 
SB 



0£7 



7 



32 
32 

31 
31 
30 
20 

32 
32 

30 
32 
32 

32 
32 
32 

29 

28 
28 
26 
25 
17 

32 

3i 

31 
31 



. 5.806 
\ 7.438 

5.000 
5.839 
6.733 
5.950 

6.437 
6.969 

7.533 
6.281 
. 4.656 

5.906 
6.437 
7*46^ 



5.655 
6.071 
^.750 
4.654 
7.440 
6.471 



6.094 
6.687 

6.742 
6.226 



2.039 








2.570 


9 


2.554 


9 




Q 


2.061 


9 


1.676 


6 


2.365 


9 


2.320 


10 


1.3oo 


0 


3.068 


10 


2.650 


10 


1.853 


10 


2.150 


9 


2.656 


10 


2.329 


9 


2.198^ 


9 


2.601 


10 


1.961 


5 


2.172 


'. 9 


2.323 


9 


2.311 




2.501 


i 


1.698 


7 



TABLE 8. DIFFICULTY LEVEL OF TASK (HRC-4) FOR DESIGN OPTIONS WITHIN EACH 
DECISION POINT SURVEYED, SAMPLE OF 32 TECHNICIANS, MYRTLE BEACH 



AFB, S.C., 


August 1974 








Decision Point 
and Option 


Nimber A 
Responding ' 


Mean 
k Response 


Standard 
■* 

Deviation 


Range 


lA 
IB 


31 
31 


\ 4 .419 
\ 6.613 


« 2.211 
2.074 


8 
8 


2A 


31 


\ 5.419 


2.721 u 


• 

10 


2B 
f 20. 
2D 


31 
30 
19 


\5.90a^ 
6.667 
6.158 


2.305 
2.371 
2.230 


8 , 
9 


3B 


32 


Ann 

D m DUU 

6.813 


9 A 0 A 

2.083 


X\) 

8 


4A 
4B 
AC 


30 
32 
32 


6.967 
5.906 
4.531 


2.549 
1.377 
^ 2.817 


10 
6 
10 


5A 
. 5B 
5C 


32 

32 t. 


5.563 
6.281 
7.187 


2.680 \ 

1.441 

2.480 


10 
5 
10 


6A 
6B 
6C 
6D 
6E 
6F 


29 
28 
28 
27 
25 
17 


^.172 
>*^.429 
5.500 
5.111 
7.480 
6.706 


2.890 
» / 2.412 , 
2.625 
2.643 
1.746 
2.844 


, 10 
9 
10 
10 
5 
10 


/A 
7B 


3Z 
32 


5. 344 
6.562 


2.313 
2.318 


9 

• 9 


8A 
8B 


31 
31 


6.774 
5.677 


2.210 
2.054 


9^ 
9 
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TABLE 9. EXTENT OF TRAINING REQUIRED,(HRC-5) FOR DESIGN OPTIONS WITHIN EACH 
DECISION POINT SURVEYED, SiMPEE OF 32 TECHNICIANS,, MYRTLE BEACH 
- AFB, S.C., AUGUST 1974 



Declalon Point Number Meah Standard 

and Option Responding Response Deviation Range 



lA ' . 


32 


' 6.219 * 


2.058 ) 


8 


IB 


32 


6.969 


1.992 


8 


2A 


30 


4.833 


2.911 


10 


2B 


30 ' 


5.333 


2 . 547 


9 


2C 


28- 


^ 6.929 


' 1.668 


6 


2D 


18 


6.389 . 


1.860 • 


• J. 

' 7 


3A 


32 


5.906 


2.542 


10 


3B 


32 


6. 906 


2.037 


7 


4A 


30 


7.500 


y 2.655 


10 


4B 


32 


6.031 


1.447 


6 


4C I 


32 


4.062 


2.657 




5A 


32 


5.969 


2.038 


10 


5B 


32 


6.156 


1.641 


7 


5C L 


32 


6.813 


2.674 


10 


6A. r . 


29 


6.^0 


2.479 


,10 


6B . 


28 


•7.036 


• 2.442 


9 


6C 


28 


5.893 


2.677 


9 


6D 


27 


5.481 


2.672 


10 


6E 


25 


' 7.520 


2.100 


7 


6F 


17 


6.824 


3.091 


10 


7A 


32 


5.875 


1.798 


8 


7B 


32 


6.531 


2.106 


9 


8A 


31 


7.065 


1.684 


5 


8B , 


31 


5.774 


. 1.963 


9 



TABLE 10. ENVIRONMENTAL EFFECTS ON MAINTENANCE AND TROUBLESHOOTING (HRC-6) 
FOR DESIGN OPtlONS WITHIN EACH DECISION JPOINT SURVEYED, SAMPLE 
OF 32 TECHNICIANS, MYRTLE BEACH AFB, S.C?", AUGUST 1974 



Decision Point 


-■-1. - ^ 

Number 


Mean 


' Standard 




and Option 


Responding 


Response 


Deviation 


Range 


1 A 

lA 


— ; ? 

32 


6.344 


' 2.056 


9 


IB 


32 


7.312 


2.083 


7 




30 


5.900 


2.925 


10 


2B 


30 


6.500 


2.306 


9 


2C 


28 


6.393 


2.193 


8 


2D * . 


18 


6.389 


2.240 


10 


3A 


32 


^^ i6.406 


2.691 


10 


3B 


32 . 


7.500 


2.222 


8 


A A 

»»A 


, 30 ^ 


^ 7 . 600 


2.525 


10 


4B 


32 


6<^37 


1.580 


6 


4C 


32 

• 


5.031 


2.628 


10 


5A 


32 


' 6.312 


2.284 


10 


5B 


32 


6.781 


1.866 


/- 6 


5G 


32 t 


7.281 


♦ 2.695 • 


.•^^"S^ 10 


6A , ' 


29 ) 


6.655 


2.467. 


9 


6B • 


28 / 


7.214 


/ 2.242 


9 




28 


•'6.786 


/ . 2.258 


8 


^D 


27 


6<741 , 


-., / ' 2.351 


9 


6E 


25 


7.520 . 


/ 2.100 


.7 „ 


6F 


16/ 


7.18;^ 


/ 3.087 


10 


7A 


32 


6^156 / 


2.539 


9 


7B 


32 / 


^^.969 


2.365 „ 


9 


8A 


31 


6.645 


2.222 


8 


SB 


31 


6.323 


2.234 


8 



35 

24 
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TABLE 11. TIME^ REQUIRED FOR mJCSNTENANCE OR TROUBLESHOOTING (HRC-7) FOR 
DmCN OPTIONS WITHIN EACH DECISION POINT SURVEYED, SAMPLE 
OF 32 TECHNICIANS, MYRTLE BEACH APB, ^.C, AUGUST 1974 



Decls;Lon Point 
and Option / 




2A 
2B 

2C 
2D 

3A 
3B 

4A 
AB 
4C 

5A 
5B 

,5C 

6A 

6B 

6C 

6D 

6E . 

6F 

7A 
7B 

'8A 
8B, 



*3 



30 
30 
28 
18 

32 
32 

30 
32 
'32 

32 
32 
32 

29 
28 
28 
27 
25 
16 

32 
32 

31 
31 



4.938 


1. 952 


8 


6.84L 


2.093 


.9 . 


5.367 


2. 822 


« ' ' 

i n 


5.767 


2.629 


9 


5.714' 


2.033 


9 


5.833 


2.192, 


10 


5.531 


' 2.436 


10 


6.875 


2.088 




7.367 . 


2.858 


10 , 


5.844 


1.583 


7 


4.156 
\ 


2.635 


10 


5.719 


2.540 


10 


6.562 V , 


1.580 


6 


7.000 


2.750 • 




5.586, 


2.312 


10 


6.357 ' 


2.423 ' 


9 


5.536 


2.337 


; 9 


4.963 


2.617 


I 10 » 


7.440 


1.982 


; 7 


6.813 


3.186 


1 10 


5.469 


2.634 


' 9 


6.094' 


2.416 


10 


6.613 


2.120 


9 


5.645 


2.336 


•9 



36 
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In seeking to compare the pattern of response for the selected human 
resource components at the decision points choseq from the DAIS-DODT, it 
can be s.een from Tables 5 through 3^ that the choice at four decision points 
is limited to two options each. Thus, the hypothesis of no difference is 
t^estable by means of a two-sample t-test. Based on the assumptions of equal 
means and equal "but. unknown variances, this test was employed. The accept- 
tdject decision at the 0.05 level of significance for each HRC/decision point 
so tested ±6 shown in Table 12. This analysis revealed that 11 comparisons 
out of 28 \(oxxld be interpreted " as representing real differences in the human' 
resource coJijponents involved. (The probability of such an occurrence is 
computed to be P = 4.38x10"^.) 



TABIyE 12. 



ACCJEPT-REJECT, DECISION FOR THE NULL ,HYPOTHESIS+ RESULTING FROM 
COMPUTATION pF TWO-SAMPLE t-TESTS FOli THE HUMAN RESOURCE COMPONENTS 
AND DECISION POINTS SHOWN TOGETHER WITH THE PER CENT OF REJECTION 
OF THE NULL HYPOTHESIS FOR EACH HUMAll REStJURCE tOMPONENT 



URC 




cision Po«its 



(A.B) 



(A,B) ^-^ (A^) 



Per Cent 
Rejection 



1 

2 
3 
4 
5 
6 
7 



r5 

R 

R 

R 

A 

A " 

R 



A 
A 

''A. 
R 
A 
A 
R 



R 
A 
A 
R 

A 
A 
A 



R_ 
'A 
A 
A 
R 
A 
A 



75 
25 
25 
75- 
25 
0 
50 



I « 



' '''Decision made at' the 0.05 level of sigr/if icance. 
A = Accept the null hypothesis; R = Reject the hull hypothesis. 
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37 
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J The remili^ng yie^slon points, four In number, all contained mote than 

two options.^ •Pat'khls reason, a n^ultiple range statistic was sele^te^, to 
allow .the assessnA^ of all possible comparlfsons between the 'options at each 
fdeclalon point./ The tdsults o/ these 'compkrlsons are presented In the table 



mmmm 



neClS'lOn pOXHC./ XUt: tcauj-ta u* i- 

included as A|4^ndlx E to this reponK:: Al^o Included in this table is an 
analysis of/Vat lancfe fpr tj^ options o^ feach decision point. 



The F-ratlo is 



used here/^^ an overall Yest' of the x^iill hypothesis (Oi « O2 = ••• = ^k^ 
prler 's:o^}>ixis the n^ure of 'the /if f ereiices between the treatment means. 



\ 



% Sl^bwn in Table 13-is the acc/ept-reject decision pattern for the PAIS 
decls^n points studied which cc/ntalned more than twq^tions. Fifteen of 
the 28 comparisons shown in thl^ table would be accepted as r^Msentlng real 
differences in the hiflnan resouficce compon^fnts Involved. 



^ TABLE. 13. ACCEPT-REJECT DECISION FOR 
AJSfALYSIS 'OF VARl^CNCE OF TBI 
PQI»fS 'SHOWN. T0GETHER.-WIT41 
HYPOTHESIS >0R EACH HUMAN 




1 



LL HYPOTHESi^l' RESULTINp-TROM 

^ RESOURCE COMPONENTS AND DECJSION^ 

IPER CENT 01: REJECTION^F THE NITLL . 
^SOURCE COMPONENT 



HRC 



■1 
2 
3 
4 
5 
6 
7 



/ERJ.C 



Decision Points 
5 ' 



6 



(A.B.C.d/ (A.B.C) 



(A,B,C) (A,,B,C,D,E,F) 



R'' 

A 

A 

A 

R 

A 

A 



R 
A 
R 

R' 
R 

R 

R 



77 



R 
A 
R 
R 
A 
A 
R 



R 
A 
R 
R 
A 
A 
A 



Per Cent^ 
Rejection 




■''Decision made at 0.05 level of significance. 

§A = Accept the null hypothesis; R = Reject the null hypothesis. 
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^a*te|n^to seek insights into underlying relationships existing 
atno^jfetfTe^^iables studied, correWion matrices for each of the human re- 
c(^oiients against items of background inf oinftatipn were computed . "^he 
ble^' in which the correlation matrices are shown in abbreviated f ofrm ate 
co;r1r4ined in AppendlxIP. For ease of readi#2he table, a value is entered 
^liiy for those variables achieving a correction significant at the 0.05 
Uvel or better. This presentation makes/is readily appa^nt that of a : 
possible 1176 correlations, only 77 achieved significance. 
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D;tSC(jSSlOK . 



■■■■/• 



human 
system 
An 



The purpose of this study was to dtefvelopV apply, and evaluatetehe 
feasibility of a procedure fox measuring the effects, of technolijgy on 
^esoui^ces. Interest was centered on development of a topik^ox use by 
designers and manpower planftets which would permit pc^ specification, 
advance of system development, olc the effects o|^^ technological inn(^|ration 
on the 'human resources ret^uired to interact w^th the technology in o^kration 
and maintenance of the system. . , 

Three classes of data have been included .in the study: First, seven 
human resource components selected to demonstrate the feasibility of associ- 
afeine human resource components with hardware decision options; 'secoM, tHfe 
hardware decision options at ei^ht decision pointy In the, cgnceiptyaltt^ - 
digital avionics information system selected by f epresentati/^es of ^he^^ir // 
Ik>r<^e; and. third /-selectfed backgrocftfd aSfdvCxlper iehce ih^orm^tlb'^^ thJg^'tlj^tiT^' 
iiiiclana- who se;tve as the source of thfe data, t ^ / 



/ 




lyk 4kta collected have bq,en analyzed through tests 
hyiJothesis involving analysis of variance and t-tjaftts, throug 
r^tige test procedures to' study patter,ns of differences, ^and;^hrougli 
lation techniques iiy^estigating relat'lonships wit;h select^ backgr 

For the s^ven hamart resourcjB components- selected for 
the sutvey. resultfs indicate that" four of the, components, 
prfeferpnceV skill level required, difficulty level of tas ^ 
to maintain or troubleshoot wei^ignlf icantly impacted -In half or more^f 
the' decision poit\t/optj^n alternatives sampled. Further, the optio^ avail- 
able at three of t'he decision points studied appeared to have th^4eavie8t 
impact. on the human resource components under investigation, J^pee decision 
points impacting on four or more of the human resource component^ were: 
the choice of single or multiple multiplex data buses for the system; the 
commonality of LRU processors; and the type of software structure. Table lA 
shows the combined t-/est and F-ratio accept-reject matrix for the seven HRCs 
and eight decision points. 
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TABLE 14. COMPLETE ACGEPT-REJECT MATRIX FOR THE SEVEN HUMAN RESOURCE , 

COMPONENTS AND THE EIGHT DECISION. POINTS SURVEYED IN THE DArS-^DODT' 
,.■ SURVEY ■ ■ ■ ,;•'*■■ • 









Decision Points t 


0 




Per* Sent 
Rejection 


1 




3 


4 


5 


6 


7 


8 


1 


R 


» — 

R 


A 


p 


D 
l\ 




Rv 


R 


88 


2 


R 


A 


A 


A 


A 


A 


A 


A 


12 


3 


R 


A 


A 


R 


R 


»R 


A 


A 


50 


4 


R 


A 


R 


R 


R 


R 


R 


A 


75 


■ 5 


A 

* 


R 


A 


R 


A 


A 


A 


R 


i 38 


6 


A 


A 


A 


R 


A 


A- 


A 


A , , 


12 


; 7 


R 


A 


R . 


R . 


A 


R 


A 


A 


50 



t Decision Points 1, 3, 7 and 8 compared by m^ans of t-tests; 
decision points 2, 4, 5^. and .6, by F-^ratios. ^ 
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Reflected below for the foiar fiRCs most heavily impacted are th^ 

4esign options producing the impact* Included in parenthesis is the number 
of the decision point and the letter designatiion of the option. 

Worker Preference: ' . 

Single'tmultiplex data bus (MDB) (lA) 

EjLectro/optical bus (2C) - 

Common peripheral processors (4C) 

•Modular software structure (5A) 

Core .memory in CPU (6A) ^ 

aRTU serVing only one^ subsystem (7A) / 

Modular signal modification equipment (SB) 



Lower Skill Levels : 
Single MDB (lA) 

Common peripheral p^oczessors (4C) 
Modular software structure (5A) 
Tape mdtory (6D) 



..U<J<UJJ.J.!<IlJ.JlW«nJUJIl|i)il,,.IUMI14IILLU.IWIljp|W 



Least Di?flcult Task Options: 
Single MDB (lA) 

'single central processor (3A) ; . 

Common peripheral processors (4C) 
Modular software (5A) 
Either core or tape memory (6A) (6D) 
• RTU serving one subsystem ^(7A) 

Least Maintenance Time Required forS^ 
Single MDB (lA) 
Single central processor (3A) 
Coxmnon peripheral processors (4C) . ^ 

Modular tf5**tware (5A) " . 

In addition to the human factor considerations. It Is Interesting to note 
the engineering implications of these choices as well. For examjple, consider 
the choices related to--the memory type shown in Figure 1. As noted earlier, 
in discussing, the four HRCs (worker preference, lower skill levels, least 

difficult task, and least maintenance time), there appeared to be a signif 1- 

• • • 

cant HRC impact in considering either tape or core memory- This tends to 
indicate that there is a direct relationship between the degree of engineering 
sophistication and the level of demand on the human factors elements, i.e., 
as the system becomes Inore complex so does the impact on htunan factors. From 
an engineering standpoint, it may be more convenient to utilize some other 
"memory such as disc or semiconductor because of packaging, power requirements, 
etc., whereas from a human factors standpoint, the logical choice would be 
core or tape. Herein lies the contradic^tioh between the engineering- choice 
and the choice dictated by consideration of the human factors elements. 
However, without a procedure to evaluatei such a^ tradeoff, the, impact of human 
factors cannot be considered in the design phase of the system since the 
design engineer would have the total responsibility for the design choice. 
It must be pointed out, however, that consideration of human factors has in 
effect long-term engineering implications in that once a system is designed, 
it must be maintained and kept in an operational status. Therefore, initially 
there may appear to be* a contradiction between engineering implications and 
human factors, but in effect the two approaches are compatible. 
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Figure 1. Various Types "bf Memories to be Considered In Digital Avionics 
Information Systems. 
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• Using a segment of the DAISHDODT as an example of assignment of derived 
human resourt^e component values at the decision point options, an lllustra- 

-tlpn of the decision traces possible and of the utility of the to<^ to system' 
deslgiters and manpower planner^ can be provided. In Figure 2, dJ4^erent paths 

-^^ggoj^^^iesr^hroujgh a segment of the DODT.^ The^ paths are held stable^XMpt^ 
far progress through ^^^eejDf^^^ decision plaints studted.^^ 

It Is possible to progress through the design tree with a^^oal of 
mlnlmlz^lng the Impaet: on the human resource components, (HRC) associated with 
each point. For example, following , this phlloso|Jhy for three jiuman resource 
components (skill levels required, difficulty of maintenance or trouble- 
shooting, and time reqiilred to maintain or troubleshoot)would result in 
following the path coded "1" through the tree. The total HRC Impact Sdote 
for this path is 33.3. If the v^orst case had been observed at each decision 
point for each of th^ 3 HRCs then the attained score would be 90. Next con-^ 
sider the path marked* "2V\ This path depicts a system where at ^11 
decision points thb options represenfilng advanced technology are selected. . 
The HRC Impact Score in this Instance is 53.2. Thus the separate design 
philosophies through this segment of the DAIS-DODT result in scores of 33.3 
and 53.2. Both of »these compare against the worst case score of 90 as well 
as against each other. Thus, the value of a trade study at these points , 
weighting available or obtainable human resources against technological re- 
quirements of a proposal system can be defined and accomplished by a system 
designer or other planners concerned with Air Force human resources. In 
these examples, the system segment could be designed to conserve any ^ne or \ 
all of the ^ three human resource components. 

The results obtained from the correlational relationships between the 
design options and the items of background information surveyed are 
disappointing on the basis of numbers of significant correlations obtained. 
This phase of the analysis must be regarded as producing negative results. 
One possible insight resulting from inspection of these data is the sug- 
gestion that a changing relationship in worker response to different tech- 
nological sblutlons on the basis of Increases in age and e>f:perlence might 
be operating. As an example, the single multiple data bus, significantly 
favored by the overall group of respondents, 1^ viewed by the older 
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Figure 2. Segment of the Design Option Decision Tree Used to 
Demonstrate Decision Trades a^id Utility of Format. 
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respondents as being nore difficult to maintain and troublejBhoot, to Irequlre 
■ore training, and to have maintenance and troubleshooting activities more 
adversely affected by extremes In the environment. However, additional 
supportive evidence would be necessary to establish an acceptable level of 
confidence In such a statement. • . 



Unfortunately, the age distribution of the survey respondents was not 
under experimental control and, as reflected In Table 2, w&s heavily skewed 
In the direction of the youngfer ages. Projections of the age composition 
of the maintenance force In /the time-frame for which an Incoming systenj would 
be In the operational Inventory and systematic selection of a sample repre- 
sentative of this composition would permit more accurate specification of 
technology impact on human resources of specific Innovations and would 
provide a meaningful tool for engineering design and personnel actjfon decisions 
in the early conceptual stages of system. design. 
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CONCLUSIONS ♦ 

The primary- goal of this study effort was to develop techniques |or 
determining and defining the components of new technology and fot measuring 
the effects of that technology on the Air Force human resources required to 
interact with it. The Intended purpos(fe of such a technique is for prediction 
at a very early time, of changes in tecthnlcal manpower requirements from the 
perspective of changing technology. ' 
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The exlstlngllterature suppo/ted the use/bf a normative technique for 
forecasting and assessing technology. A noniatlve approach known .as a Design 
Option Decision Tree (DODT) was selected as the vehicle for locating tech- 
nology within a proposed system. 

The problem of quantizing phe impact- of projected technological innova-^ 
tlons "on human resources was not resolved through a ifeview of ^ the literature. 
No satisfactory technique was found to be in existence. 

An adaptation of the siimmated rating technique was performed and a set 
of standardized quest;lons developed to allow the collection op judgmental 
data which could be translated into quantized statements conckrning predicted 
pact of technologltal advances oh selected human resource exponents.' 

The human resource component values resulting from this process ^efe 
assigned to decision alternatives at three decision points in ^ selected SLeg- 
ment of the DAIS-DODT,. This segment was used as an iHustratlci(n of the 
utility of the p^rocedure to system designers and personnel planners in the 
Ident if legation of human resource component .trade studies required for certain 
desired dedlgli outcome^. .The advantage of the" proposed procedure lies in 
the fact that it would* permit detailed identification of human resource, com- 
ponent trade studies far in' advance of hardware design decisions! Thus, the ' 
trade study results could serve as 'input data for influencing a hardware 
design decision. < 
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^ . The results obtained from application of this methodology are/^^lt to 
detnoi\ptrate its feasibility atd appear to encourage continued r«in^mfent of 
the procedurer to result in ^he development of predictive equa^i^s/ yajtiich are 
, AO longer dependent u^on the collection of judgmental datyV/ J 
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APPEN^X A- 

INFORMATION PROCESSING 
DESIGN OPTION DECISION TREE 
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APPENDIX B 



TAC/AFHRL DESIGN OPTION DECISION 
TREE MAINTENANCE . SURVEY B00K;LET 
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NOTE; The survey 1?ooklet was set up vlth the schematic" on the left side and 
the questions on the right slde^ so that the respondent Would answer questions 
with schematic present. For purposes of cost savings only one example of the 
questions Is shown. All schematics are provided. 
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TAC/APHRL DESIGN OPTION DECISION 

TREE MAINTENANCE SURVEY ^ 

' ' ' ' ■ A' 

MYRTLE BEACH AFB. SC 



Digital Avionics 
Information Processing Systems 
(AUGUST 1974) 
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DIBSIGH OPTION DECISION TREE 
MAINTENANCE SURVEY QUESTIONNAIRE 



l.« How would you feel about working on eac^ choice? 



Strongly One is as Good Strongly 

y Opposed as Another Fa3^r 




2. How luuch- would a written procedural manual help with maintaining 
6r troubleshooting each choice? 

I ^ I - • I 

^ Strongly. ^ Neither Hinder Strongly 

Hinder Nor Help Help 



3, Indicate the at&punt of skill needeH to maintain or troubleshoot 
each choice. . • ■ * . 



Very Average Most 

Little 



4. How difficult would be the task of maintaining or troubleshooting 
each' choice? p / 



Very Avetage ' Very 

Easy ^ Difficult 



5* How much training 1$ necessary to maintain or troubleshoot 
each choice? 



Very Average " Great 

Little Amount Amount 



6. How difficult would it be to maintain or troubleshoot each choice 
in« extreme environments? 



I- — —I ' ■ — I 

Little ^ Average Strong 

Difficulty Difficulty • Difficulty 



7. How time consuming do you feel maintaining or troubleshooting each 
choice would be? 



Very Average Great 

Little '• Amount 
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DESIGN OPTION DECISION IfREE MAINTENANG? StIRVEY 
I^j^SOpEL BACKGlioUND INFORMATION QUESTIONNAIRE 



1. Name : : ' x:::^, ^ • ^ • • ^* oRanfc 



3^ Organization / / ' . ' ■ ' ' - J j ^ 

^ 5,^ Duty AFSC I 



; . . . i 
6 . Job Title i 



7; Number 6f calendar months in pr^sisnt assignment 
8* Total years of .duty related experience . 



9. Types of aircraft woT;;ked on and system worked qri in eadh aircraft. 



•/V 



10. Total number of years in military service 

11. List technical service schools- attendisid 



12. In what specialty do you feel best qualified? 



13. What is higjiest school grade completed? ; ^_ 

14. How many of the pasi- five years are applicable to present diity 
assignment? . . . • ' 
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DATA RECORDING FORM 
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APPENDIX D 



INSTRUCTIONS TO INTERVIEWERS 
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. OUTLINE . • 

TOPICS TO BE DISCUSSED WITH SURVEY RESPONDENTS ^ i 

Both th^ periods of a^^lability of respondents and the numbers available 
at a given time are subject to variation. For this reason, rather than pro- 
vide a verbatim script of instructions to respondents, an outline of the topics 
which should be covered is provided. It is Important that respondents under- 
stand exactly the nature of the task being asked of them. For this reason, be 
certain that all questions are answered to the groups' satisfaction before 
proceeding. ' * 

Topics 

■ » * . 

1. Survey Introduction ^ 

A. Name of SRL interviewers • / \ ' 

B. Identification of sponsor ^ 
Reason for being there 

— to collect data' relati?cig tP digital avionics 

D. Purpose for collecting data * . 

— to attach meaningful ntmibers to decision alternatives related 
to digital avionics 

— trying to develop a prbcedure which will permit Air Force 
system^designers to take Into consideration the effects of 
certain -design decisions on maintenance and troubleshooting 
so tjiat, for examplOf a system can be designed for ease of 
maintenance where possible. - 

E. Why Myrtle fieach AFB ) * 

— A-7 experience (digital equipment). (Avionics Labor*atory at: 
WPAFB using A^-? avionics as base line for DAIS development) 



\ 



DODT (DAIS) Presentation and Explanation 

A. ExjSilain what the task is 

B. Emphasize this is to be done only for 8 decisipn points NOT 
entire tree 
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Intended Use for ^Myrtle^each AFB Survey Information 

A, Seeking to attach mean3|ggful numbers to various decisions 
related to wekpon system ^ ^ 

B. Trying to get information which will allow consideration 
the human maintenance and opprdtion problems of a system. 

Example: ' 




Cost $30,000 
Troubleshoot 

Time: 100 hrs 



Cost ?35,0U0 ~ 
Troubleshoot 

Time: 10 hrs 



Procedure to be follow 



A. 
•B. 
C. 



ika: 



Ask for any questions on what has been said 
Pass out -survey 

Go over examples A and B Below 




How would you feel about working on each 



Strongly 
Opposed 



One as good 
as another 



Strongly 
Favor 
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r 



Color TV 
Monitor 



B&W TV 
Monitor 



ow difficult ^^would be the task of minimizing each chbice 



Vfery 
Easy 



Avetage Very 
^Dif^iculty Diffic^t 



D. Ask for. questions on procedure to be followed, 
"E^ Instruct technicians to proceed ^th the survey « ' 

' F, Be sure to indicate that questions may be asked .at any^ point On 

the procedure to be folloi^d. * ? 
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APPENDIX E 



SUMMARY Sl^LE OF ANALYSIS tiF 
VARIANCE AND STUDENT-NEWMAN-KEULS 
TEST OF DIFFERENCES BETWEEN MEANS 
FOR HUMAN RESOURCE COMPONENTS AND 
DECISION POINTS INDICATED 
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TABLE B^. SUMMARY TOUSLE OF ANALYSIS 03^_ yARIANCE AND STUDENT-NEWrtAN-piJLS/^ 
TEST OP DIFiftRpNCES BETWEEN MEANS FOR HUMAN RESOURCE COMPONEl^l^; 
AND J)ECISiON b'OINTS INDICATED * x 
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Options „ 
Exp. Error 
• Total 



S-N-K 



Order 



Option 



B 
A 

c 



luman Resource Comgon^ot 1 
Decision foipt 2 
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69**, 
48* 



ANOVA 



A 
C 
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SS 


df . 


MS 


F 
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pptlons 
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/A 



♦H^n*Resource Component 2 



Decision Point 2 



ANOVA 
Source 



SS 



Options • 
Total . 



10.09 
293w?2 
303. 82 



.2 
84 

/ 

^ 86 



Order 



' 2 



Option 



A i 




MS 




SS 



Decision Point 4' . 



df 



:5.05 
3.50 



23 
18 



MS 



0.42 2 
234.47 . / ' , 87 . 
234.^9- // ■ 89 



'0.21 
2. 70 



1.44 
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S-N-K 



Order 




> 2._^ 



B. 



5 
3 
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f 

ANOVA 




Decision Point 5 



Source 


ss 


•/ 


df 


\ 




MS 
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0.93 




,2 






0.46 




EXp,. ^rror 


229.35 
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] 




2.55 
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230.28 
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ANOVA / 
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Exp. Error 
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A 
B 
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Human Resource Component 4 
"itecision Point 2 



SS 



Option 23,49 
Exp. Error ^ 561.50 
- Total > 584.99 



A . 



df 



2 
87 
89' 
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24 
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ANOVA 
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SS 
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df 



MS 
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■ Exp. Error 
Total 



S-N-K 



Order 



Option 



C 
B 
A 



81.67 
486.73 
'568.40 
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5.59 
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ANOVA 

* Source 



SS 
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df 



MS 
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^xp. Error 
Total 



,42.44 
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5.30 
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B 
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df 
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115 
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29 
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B 



4 
2 



20 

\^ 
16 



4.32* 



E/' 



57** 
55** 
53** 
37* 



er|c 



84 
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ANOVA 



Source 



Option 
Exp. Error 
Total 




Human Resource Comfcpnent 5 



, Decision Point 2 



SS 



68.64 
523.68 
592.32 



df 



- 2 
81 
83 



MS 



34.32 
6.47 



5.31** 



S-N-K 



Order 



Option 



A 
B 

C 



ANOVA 



Source 



13 



Decisi^i 



Point 4 



SS 



'df 



59** 
4.6* 



MS 



Option 
Exp. Error 
Total 



18^^2 
669.79 



/ 



2 
87 
89 



92.21 
5.58 



16.53** 



S-N-K 



Order 



Option 



C 
B 
A 



58** 
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47* 
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r 



Decision Point 5 



ANOVA 



Source 




bb 


dr 




MS 




F 


Option r 




12.56 


2 




6.28 




1.30 


Exp. Error 


* 


448.06 


93 




4.82 






Total 




460.62 
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SS 


df 
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SS 
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510.81 
525.83 



df 
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93 
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MS 
7.51 
5*49 
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Option 
A 
B 

.C 



15 
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SS 



df 



MS 
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Exp^ Error 
Total 



S-N-K 



10.13 
576.46 
586.59 
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r 



2.53 
5.01 
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ANOVA 



Source 



Human Resource Component 1- 
Declslon Bolnt 2 



SS 



df 



Option 
Eytp. Error 
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2,00 
555.29 
557.29 



2 
81 
83 



l.po 



S-N-K 



Order 



Option 



B 



B 



8 
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2 
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Source 



SS 



Decl&lon Point 4 



df 



MS 



Option 
Exp. Error 
Total 



160.07 
527.53 
.687.60 



2 
87 
89 



80.03 
•6.06 



13.20** 
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1 : 
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df 



MS 
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528.34 
555.49 



A 
B 
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2 
93 
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B 
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41 
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Decision Point 6 
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SS 


df 




1 

MS ' 


F 


Option 


88.58 


- 4 


/ 
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4.44* 


Exp. Error 


574.08 


115 




4.99 




Total 


662.67 , 
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B 
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D" 




11 


18 


31 


60** 



c 

i^A, 
B 



X 




20 
13 



49* 
42* 



**^ Denotes IS tatiis tic al Slignlf Icance at the^O.Ol level or better, 
* Denotes s\itlstica3k Significance at the 0.^5 level or better. 
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APPENDIX F 



SIGNIFICANT /COREtlLATIONS EXISTING 
BETWEEN SPECIETED DESIGN 
OPTIONS AND pBSIGNATED " 
BACKGROUND INFORMATION ITEM 
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TABX-E F-1.- SIGNIFICANT CORRELATIONS EXISTING BETWEEN SPECIFIED DESIGN 
, OPTIONS AND ITEMS OF BACKGROUND INEDRMATION INDICAIED FOR 
TftE HUMAN RESOURCE COMPONENT - WORK PREFERENCE ^ SAMPLTE OF 
* 32 MAINTENANCE TECHNICIANS, 354th AVIONICS SQUADRON, . 

MYRTLE .BEACH, SOUTH CAROLltJA, "AUGUST 1974 I 





* #" 
Background Information 




• * 


o . Yrs- Yrs 


Last 5 


^ Rank Age 


^/^sgn Xper Sv^' ^ Sch 


Yrs Exp 



8A 



0.398 0.468 



0.357- 0.582 




0.407 



-0.374 



.0.355 



0^. 392 



-0.437 



0.536 
-a. 450 



-0.416 



-0.37^' 



TABLE F-2. "SIGNIFICANT CORIffiLATIONS EXISTING BETWEEN .SPECIFIED DESIGN 
. ■ ' OPTIONS AND ITEMS -OJ" .BACKGROUND INFORMATION INbLCATED FOR- 
THE HUMAN RESOURCE ''COMPONENT - WRITTEN PROCEDURES . S/^LE 
OF 32 MAINTENANCE TECHNICIANS, 354t;h AVIONICS SQUAMON, 
MYRTLE b'EA'CH. 'SOUI?! CAROLINA, AUGUST 1974 



. ^ ' " Background Information 

Rank Age • Asgn. ' Xper . 



Yrs 
Svs 



' Yrs 
Sch 



Last 5' 



4C 
6A 
6B 



0.460 
0.486 



6C 0.433 

8A 

8B 



0.406 



0.367 



I 



0.411 
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-TABLE F-3. SIGNIFICANT CORRELATIONS EXISTING BETWEEN SPECIFIED DESIGN' 
OPTIONS AND ITEMS OF BACKGROUND INFORMATION INDICATED FOR 
T^IE' HUMAN RESOURCE COMPONENT - SKILL REQUIRED , SAMPLE'"-0F 
; 32 MAINTENANCE TECHNICIANS, 354th AVIONICS SQUADRON, - ' 
MYRTLE BEACH, SOUTH CAROLINA, AUGUST 1974 • * 



Background Information 



Rank 



Age 



Asgn 



Xper 



Yrs 
Svs 



Yra 
Sch 



Last 5 
Yys Exp' 



IB 
2B 

3A 
•4B 
6A 
6B 



0.393 



0.356 



0.39? 



0.365 



-0.501 



-i^O;524 



-0.407 



TABLE F-4. SIGNIFICANT CORRELATIONS EXISTING BETWEEN SPECIFIED DESIGN 
- • -- OPTIONS AND ITEMS OF- BACKGROUND INFORMATION, INDICATED FOR 
THE HUMAN RESOURCE COMPONENT - DIFFICULTY . SAMPLE OF 32 / 
MAINTENANCE TECHNldlANS, 354th AVIONICS SQUADRON, .'mYRTLE BEAi: 
SOUTH CAROLINA, AUGUST 1974, . ' / 



Background Information 



Rank 



Age 



Yrs 
Svs 



lA 0.451 0.503- 0.378 



2A 
2B 
3A 



('3B. y 

5B ;9:'375 
6A / ' 



0.362 • 



6B 



-p. 508. 




0.484 
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TABLE F-5". SIGNIFICANT CORRELATIONS EXISTlte BETWEEN SIjfiCIFIEjytESIGN 
OPTIONS -AND ITEJIS OF BACKGROUND INFORMATIONb I liDJCATED FOR. 
THE HUMAN RESOURCE COMPONENT-- TRAINING I^QUIRJ^D . S^LE OF 
^ 32 MAINTENANCE TECHNICIANS, 3^4th AVIONICS SQUADRON,, 

■4 ' WRTLE BEACH, SOUTH CAROLINA, AUGUST *1974' . • 





0 


■ « ■ ■ * 

V 

» 


Background 


Information 


' 0 


0 

. Yrs^ 
5 "Sch 






ft 

Rank 


Age 


. Asgn 


Xper 


Yrs 
Svs 

• 


•Last 5^ 
Yrs Exp 


■ /■ 

IB 


0 






V/ i *t X 4* 




-0 . 431 




3A 








0.392 . 








■ 5B 


0.369^ 


q(&86; 




0.458 


' . / 






- 6A : 


0 




0.458 














It ^ 
' t ■ 


' 0 


6.438 

. . --^ - 
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TABL^ Ft6. significant CORRELAttONS EXISTING BETWEEN SPECIFIED PESIGN 
OPTION^ AND ITEMS *X)y BACKGROUND INFDRMAJION INDICATED FOR. 
THE HUMAN RESOURCE COMPONkNT - EXTREhE -ENVIRONMENTS , ^SAMPLE 
OF ,32 MAINTTENANCE T^NftlANS, 35,Ath^ AVIONICS SQllADRON, 
MYRJLE BEAOr^ ^SpUTH CAROLINA,! AUGUSt' 1974 ^ - " y 



background Inrormatloi;^ 



Rank 



Age 



, Asgn 



Xper 



Yr's « V Yrs 
Svs Sch 



Yrs ^xp 




lA 0.356 
2B 0.385 
3A , 



5A 



6A 



Q.401 



7 



' 0.. 399 



0.349 



0.426 



0,.-428 0 



"0.412 



-0.40 



0.531 



0^53, 
K Q.353 
^ i)-.365 




TABLE. F-7. ^SIGNIFICANT .CORREUTIOWa 'EXISTING BETWEEN SPECIFIED DESIGN 

. • OPTIONS Am ITEMS 'OF tfACKGROUJjD INFORMATION INPiCATED FOR / 

• . • . THE HUMAN RESOUftCE COMPONEJir .- TIME REQUIRED / SAMPLE OF 32 

. '*'// MAINTENANCE TEpiliifei^AlJS, /354th AVIONI^ SQUADRON, MYRTLE BEACH. 

V^/// SOUTH.sCAROLINA,. AUGlffiT-/i974 - 



Rank/ / Age. - ' ^^Asgp 




Background Information 

Xper • ' Svs 



6B 



-0.515 
-0.462 




6D -0.531 ^' -0UA6 r0.505 -0.538 




0^ 




ERIC 







79^ ^ 



